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We show in detail how to determine the time-reversed representation of a stationary hidden 
stochastic process from hnear combinations of its forward-time e-machine causal states. This also 
gives a check for the fc-cryptic expansion recently introduced to explore the temporal range over 
which internal state information is spread. 
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INTRODUCTION 

We introduced a new system "invariant" — the cryp- 
ticity X — for stationary hidden stochastic processes to 
capture how much internal state information is directly 
accessible (or not) from observations [J, [1,01. Two ap- 
proaches to calculate Y were given. The first, reported 
in Ref. [l[ and Ref. 0, used the so-called mixed-state 
method, which employs linear combinations of a pro- 
cess's forward-time e-machine. The second, appearing 
in Ref. developed a systematic expansion x{k) as a 
function of the length k of observed sequences over which 
internal state information can be extracted. The mixed- 
state method is the most efficient way to calculate cryp- 
ticity and other important system properties, such as the 
excess entropy E, since it avoids having to write out all 
of the terms required for calculating x(fc)- It also docs 
not rely on knowing in advance a process's cryptic order. 

As such, we reported results in Ref. Q that use the 
mixed-state method to, in a sense, calibrate the x(^) 
expansion and to understand its convergence. 

Here we provide the calculational details behind those 
results. Generally, though, the goal is to find out what 
a stochastic process looks like when scanned in the "op- 
posite" time direction. Specifically, starting with a given 
e-machine M of a process, calculate its reverse-time rep- 
resentation M~. (The latter is not always minimal and 
so not, in that case, an e-machinc.) This is done in two 
steps: (i) time-reverse M, producing M = T{M), and (ii) 
convert M to a unifilar presentation U{M) using mixed 
states, which are linear combinations of the states of M. 

In the following, we show how to implement these steps 
for the various example processes presented in Ref. [3|: 
the Butterfly, Restricted Golden Mean, and Nemo Pro- 
cesses. We jump directly into the calculations, assuming 
the reader is familiar with Refs. Q, 0, and i. Those 
references provide, in addition, more discussion and mo- 
tivation and reasonable list of citations. 




FIG. 1: A 2-cryptic process: The e-machine representation 
of the Butterfly Process. Edge labels t\x give the probability 



t = t''-^] of making a transition and from causal state a to 

(TO" ^ 

causal state a and seeing symbol x. 

BUTTERFLY PROCESS 

Figure [T] shows the e-machine for Ref. 0]'s Butter- 
fly process — an output process over eight symbols A = 
{0,1,. ..,7}. 

Since its transition matrices are doubly stochastic, the 
stationary state distribution is uniform. This immedi- 
ately gives its stored information: the statistical com- 
plexity is — log2(5) bits. It also makes the construc- 
tion of the time-reverse machine straightforward: We 
simply reverse the directions of all the arrows. (See Fig. 
[5]) Note that the time- reverse presentation is no longer 
unifilar and, therefore, it is not the reversed process's 
e-machine. 

Due to this we must calculate the mixed-state pre- 
sentation to find a unifilar presentation. The calculated 
mixed states and the words which induce them are given 
in Table U 

The result is the reverse e-machine shown in Fig. [31 
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FIG. 2; Time-reversed Butterfly Process. 



AUowed Words 


fi or Previous Word 





(0,|,0,i,0) 


1 


(0,0,i,0,i) 


2 


(1,0,0,0,0) 


3 


2 


4 


(0,1,0,0,0) 


5 


(0,0,0,1,0) 


6 


(0,0,1,0,0) 


7 


(0,0,0,0,1) 


02 


2 


03 


2 


04 


4 


05 


5 


10 





16 


6 


17 


7 


21 


1 


42 


2 


44 


4 


53 


2 


55 


5 


60 


4 


66 


6 


70 


5 


77 
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TABLE I: Calculating the time-reversed Butterfly Process's 
e-machine via the forward e-machine's mixed states. The 5- 
vector denotes the mixed-state distribution ^(ui) reached after 
having seen the corresponding aUowed word w. If the word 
leads to a unique state with probabihty one, we give instead 
the state's name. 



position to calculate E using the result of Ref. [l| : 

E = - X (1) 
i:^C^-H[S+\X] (2) 
= C,-H[S+\S-^e+(X)] . (3) 

In this case, we find a crypticity of: 

X = H[S+\S-] 
= 0.m[(0, i 0, i 0)] + 0.2H[{Q, 0, i 0, i)] 

+ 0.2iJ[(l, 0, 0, 0, 0)] + 0.15i?[(0, 1, 0, 0, 0)] 
+ 0.1577[(0, 0, 0, 1, 0)] + 0.1H[{0, 0, 1, 0, 0)] 
+ 0.1i7[(0,0,0,0,l)] 

= 0.1 + 0.2 

= 0.3 bits. 



So, E = log2(5) - 0.3 « 2.0219 bits, in accord with the 
result calculated via Thm. 1 of Ref. 




FIG. 3: Reverse Butterfly Process. 



Note that it has two more states than the original (for- 
ward) e-machine of Fig. [TJ 

The stationary distribution of this reversed machine 
is TT = (0.1,0.2,0.2,0.15,0.15,0.1,0.1). Now we are in 



RESTRICTED GOLDEN MEAN PROCESS 

For reference, we give the family of labeled transition 
matrices for the binary Restricted Golden Mean Process 
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(RGMP): 



/O 



T 



(0) _ 



i 









and 



\0 



/i 
10 
1 
1 




yi 

Its e-machine is given in Fig. |4]and its stationary distri- 
bution is: 



1 



1 



k + 2 




FIG. 4: The e-machine for the Restricted Golden Mean Pro- 
cess. 



FIG. 5: Time-reversed presentation of the Restricted Golden 
Mean Process. 




FIG. 6: Reverse Restricted Golden Mean Process. 



With this, wc can now compute x using i7[5^|iS ], as 
follows: 



Through other methods, we can show that the RGMP 
is reversible. We "push" RGMP to an edge machine pre- 
sentation and "pull" T(RGMP) also the same type of 
presentation. (An edge machine presentation of a ma- 
chine M has states that are the edges of M.) These 
machines are the same. Therefore, the forward and re- 
verse e-machines are the same and, moreover, we can use 
the same mixed-state inducing word list. It is easy to see 
that one such list is (0, 01, Oil, . . . , Ol''). Table |TT] gives 
the mixed states for these allowed words. It is also rea- 
sonably clear from the above mixed-state presentation 
that these correspond to the recurrent causal states for 
the time-reversed process's e-machinc. 



H[S+\S~ = 0] = H[{1,0'')] = and 



1 ^k^n 1 1 1 



H[S^\S- = 0(1)"] = H[i-, 0-", ---,...,-)] 



So that, in general, we have: 



H[S+\S-] = y -^H[i^,0''-",^ 



2 + k 



1 1 1 

2"'- '212223'' 

- --- -)] 
2*;' 21 22 23''"' 2*^'^^ 



Allowed Words 




1 

01 
10 
11 



0(1)" for 1 < n < fc 
1(1)" for 1 < n < fc 
0(1)*= 

1(1)' 
0(1)*0 
0(1)'°1 



/i or Previous Word 



f^^ 

\ fe+l ' k + l 



1 





■ ' fe+ 



ifi 1 1 



/ 1 Qfc-n 111 J_ 
l 2" ' ^ ' 2^ 2^ I^'' ■ ■ ■ ' 2" 
ife-n 111 



1 / I -.k-n 111 
fc-n + lV2'>' '21" 2^ 2^' 

/ J_ 111 J_ 
Ijfc ' 2^" 2^ ^S'' ■ ■ • ' 2'' 
0(1)* 


0(1)'' 



TABLE II: Calculating the reversed RGMP using mixed 
states over the e-machine states. 



It can then be shown that: 

1 fe_„ 111 1 
"^^(2"'^ ' 2^ 2^ 2^ ' ■ ■ ■ ' 2" 

= mrl 111 1^1 

1-^ 2" ' 2^ 2^ 2^ ' ' ' ' ' 2" 

= 2 - 2^^"") . 

Therefore, returning to the causal-state-conditional en- 
tropy of interest, we have: 



H 



k + 2 
1 

k + 2 

2k 
k + 2 



(2(fc - 1) + 2(2 - 2^-'=) - (2 - 2^-'^')) 



(l-fc)N 



With a few more steps, we arrive at our destination — the 
RGMP's informational quantities: 

= log2(fc + 2)- 



/^+2 



2k 

Y = , and 

^ k + 2' 

E = log2(/s + 2) 



2{k + l) 
k + 2 




1 - alO 



FIG. 7: The e-machine for the 00-cryptic Nemo Process. 



scanned Nemo Process. Its transition matrices are: 
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The stationary state distribution is the normalized left- 
eigenvector of T = T^"^ + r'^^-' and is given by: 



Pr(5+) = 7r+ = 



1 



3-2p 



A B C 
1 1 — p 1 ^ P 



NEMO PROCESS 



Then, the statistical complexity is the Shannon entropy 
over these states: 



We now demonstrate how to calculate x and E for 
Ref. [ll's 00-cryptic process — the Nemo Process — using 
mixed-state methods. As emphasized in Ref. the 
fc-cryptic expansion there cannot be applied in this case. 
Thus, the Nemo Process demonstrates that Refs. [l| and 
0's mixed-state method is essential. 

Figure [7] shows , the e-machine for the forward- 



log2(3-2p)-^L^log2(l-p) 
6 — 2p 



The next step is to construct the time-reversed presen- 
tation M+ = T(M+), shown in Fig. [S] The transition 




(l-g)(l-:p)|0 




l-p\0 



1 - alO 




FIG. 8: The time-reversed presentation, A/+ = T(M+), of 
the Nemo Process. 



matrices of this machine are: 
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c 











(i-'z)(i- 
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c 


Co 


1 
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(P 







f (1) 
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p) 



and 



Finally, we construct the mixed^ate presentation of 
the time-reversed presentation, U{M^), which is shown 
in Fig. [ni On doing so, we obtain the following mixed 
states: 



E = v{Ql) 



1 






pq 




1 






^q- 


pq 




1 






^q- 


pq 



A B C 

P q{l-p)). 

A B C 

q p(l - q) ) , and 

ABC 



F = u{QQl) = —^ (q p{l-q) O) 

p + q— pq \ ^ ' J 



These mixed states form the reverse e-machine causal 
states, which are exactly the same as the forward 
e-machine. Thus, the Nemo Process is causally reversible. 
The mixed states are distributions giving the probabili- 
ties of the forward causal states conditioned on a reverse 




FIG. 9: The reverse e-machine for the Nemo Process, 
causal state: 



Pr(5+|5-) 



1 



p + q-pq 



E 
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c 




P 





9(1- 


P) 
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P(l- 


q) 



F \ q p{l^q) 
We use this to directly compute: 



H[S+\S- 



1 



3-2p 



P 



p + q-pq 



log2 



P + q-pq 



p 



, 9(1 - p) 1 f p + q-pq 
+— : logs 



q 



9(1 -p) 

l0g2 



P + q-pq 

2(1 -p) 
3-2p 

p(i-g) 1 

~: ^°S2 \ n ^ 

p + q-pq \ p(^- q) 



p + q-pq 

p + q-pq 



P + q-pq 
9 



Finally, we have: 

^ = C^-H[S+\S-] 



log2(3-2p)-^LP)iog2(l_p) 



3 - 2p 



1 



P 



3-2p 
9(1 -P) 



■l0g2 



P + q-pq 



p + q-pq 

P + q-pq 



p + q-pq 

, 2(1 -p) 



log2 



3-2p 

p(i - g) 

p + q-pq 



9(1 -p) 

l0g2 



p 



p + q-pq 



p + q-pq 

p + q-pq 



log2 



p(i - 9) 



CONCLUSION 



The detailed calculations make evident that Refs. [if 
and [3]'s mixed-state method gives a new level of di- 
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rect analysis for the informational properties of station- 
ary stochastic processes, such as the crypticity and the 
excess entropy. The complementary approach given by 
the crypticity expansion x(^) is useful in understand- 
ing information accessibility — how internal state infor- 
mation is spread over time in measurement sequences Q . 
Nonetheless, while x(^) can be calculated in particular 
finite cases, the mixed-state method is the most general 
and efficient method. 
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